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ABSTBACT 

la response to an inc teasing demand for faculty 
evaluation, focus is on element-s- cf a successful evaluation program* 
It is suggested that faculty lust be consulted in otder to rxrive at 
a Mutually reed upon structure, incorporating such areas as vhlch 
sources sb 4 provide tli€ inforBatitjr or data on which the ' 
evaluation -.ll be based. Another consideration is the aspect of 
functional validity — how to insure that the instrument iiill be 
accepted anVa used by the faculty cr institution . In order to assur« 
that functional validity exists, a faculty role model must be 
established that the majority of the faculty believes to fce an 
appropriate one for the institution. Among the roles generally 
established by faculty are advising, teaching, faculty service, 
research, and professional status. Once functional iialidityt is 
determined, psychometric validity can be . established with accepted 
measurement and validation techniques, Ihe next step is the 
development of - a procedure. to produce a singular inde^ that is 
readily interpretable and will 'provide infcrmation that can be 
utiii2:ed for promotion, tenure, and merit- pay decisiors. In order to 
allow for individual differences in faculty assignments while still 
allowing t cr comparison, a series of steps is outlined. An equation 
is presented which permits the overall coiposite rating of a faculty 
member to be computed inl order to arrive at a merit pay increase 
based- on the faculty evaluation procedure, (PBR) 
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In many institutions of higher education today there .is a 
pressing and Immediate need to establish some form of faculty evalua- 
tion program or system* In many cases ^he primary impetus for an in- 
stitution entering into the arena of ^^culty evaluation Is a marndate 
from the state legislature* the board of regents,, the institution's 
president, or some other like controlling authority. Whateyer^the 
source, a directive is issued, a committee appointed, and a group of 
faculty and/or administrators finds itself In the position of having 
to design and implement a faculty evaluation program post haste. 

A common error made by such groups or committees charged with 
developing a faculty evaluation program is to>eg1n by designing a 

) 

student rating form or student evaluation questionnaire. This Is a 
trap that is easity fallen Into mainly because the bulk of the litera- 
ture in the area of faculty evaluation focuses on the qualities, char- 
acteristics, advaia:ages, virtues, faults, and. short comings of student 
ratings. Although student ratings of faculty performance are certainly 
onfi essential component of a comprehensive faculty evaluation system, • 
they are by no means the only, or av^n necessarily the most Important 

component (Costin, et. aU, 1971; Doyle, 1975*, Miller, 1974). Addition 

' ^ >. ■ 

«lly» beginning the development of a faculty evaluation prograsi with 
the design and implementation of a student rating form calls forth a 
host of criticisms based primarily upon the Issue of the validity of 
student ratings in the evaluation of faculty performance, and thus 
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jeopardizes the success of the .entire faculty evaluation effort;. 
There Is a better way to go about designing and developing a faculty 
evaluation program. ^ 

Strategy for Success ^ ^ - • 

Overcoming faculty resistance to the implementation of a faculty 
evaluation program can be a serious problem necessitating the utiliza- 
tion of a variety of strategies desglned to promote acceptance (Grasha, 
1977). Faculty members generally not only meet the introduction of - 
faculty evaluation sys.tems with something less than enthusiasm, but,* ' 

in fact, are often overtly hostile to the idea. This is especially 

r 

■Ms 

the case when the most visible first element of the faculty evaluation 
system is, a student rating form. The key "to overcoming this iresist^nce 
on the. part of the faculty, indeed the Icey to avoiding the generation 
of much of the resistance in the first place, is to involve the faculty 
in the design, of the system (Genova, et. al., 1976). Fortunately, a 
procedure may be employed which notionly involves the faculty in the 
design of the system,' but which also produces a system that h^s the 
greatest probabllityoof being valid and useful as well. 

The greatest resistance to faculty evaluation systems of any 
sort, whether they rely on student rating forms, peer evaluations, or' 
simply the judgment of an administrator, derives from the fact that 
the fundanientaT values held by those doing the evaluating may not match 
the values of those being .evaluated. In some cases, the values of those 
doing the evaluating are unknown or at least unstated or vague. Evalua- 
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tlon Is an act which requires that the person doing the evaltiating' . 
apply, a structure of values to a set of data .or Information, and thus 
wake a judgment* as to the worth of the thing or action being evaluated. 
Much of the criticismis of faculty evaluation systems or programs can 
ultimately be traced to a fundamental situation wherein the person 
being evaluated either disagrees with, or Is unsure of, tha value 
structure of the evaluator. In other words, questions concerning the 
validity of various components of a faculty evaluation system or pro- 
gram are "basically reducible to differences or doubts concerning the 
assumed value structure of the evaluator. 

Therefore, the first step, and Indeed the first critical element,/' 
in designing a comprohensive faculty evaluation system. Is to arrive at, 
a mutually agreed upon value structure for the Insltutlon, college, or 
department. Jhat Is, the following basic quest1ons.must.be ansv'^red 
for and by the faculty as a whole: 

1. What aspects of faculty performani:e should be evaluated? 

2. What source or sources should provide the Information or 

data upon, which th^ evaluation will be based? 

■ 

3. How much weight or value should be placed on the Information ' 
provided by each source? 

4. What kind of Information should be gathered from each source?' 

5. How should the informttlon be gathered <1,e«, what forms » pro- 
cedures, or protocols need to be developed)? 



- * . FACULTY :£VALUATI0N' 

Page 4 

Deteymlntng the Facult y Role Model and Faculty Value Structure ' 

A critical truth often overlooked or not recognized by measure- 
ment and evaluation specialists In designing questionnaires, forms, or 
procedures for faculty evaluation systems is the fact that the design 
and Implementation of a successful faculty evaluation program 1s as 
much a political process as it Is ajtechnical or psychometric one. 
Much time and effort is spent agv'jniiing over the validity of student 
ratings, the validity of peer evaVjatlons. and the validity of the en- 
t1re*evaluat1on process. The literature abounds with research attempts 
to validate one form or another. Although these are serious and im- 
portant questions, the most important form of validity Is what might be 
balled "functional validity". That Is. regardless of the statistical 
and psychometric characteristics that a form or procedure might possess. 
If It is not accepted and used by the faculty or institution. It has no 
"functional validity" or practical utility. 

Of primary Issue here Is how to go about establishing the func- 
tional validity of the forms and procedures of a comprehensive faculty 
evaluation system. It Is assumed that once the functional validity of 
a system has been established and the system Is operating, the is^ue 
of the psychometric validity of the various components of the system can 
be tackled with accepted measurement and validation techniques. To take 
these steps in reverse order, as Is often the case', one stands a very 
good chance of becoming bogged^down in the psychometric equivalent of 
such questions as *How many angels can dance on the Head of a pin?", 
white the pressures which originally, mandated a faculty evaluation 
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program build to the point where someone else finally designs and Im- 
plements a system disliked by everyone. 

In order to artswer the questions noted earlier, 1t« Is necessary 
to obtain certain Infonnatlon from the faculty as a whole. That is,, 

is necessary to determine the faculty role model which the majority, 
of the faculty believes to be an appropriate one for the institution. 
Additionally, the value structure of the faculty regarding the entire 
set of issues pertaining to what* Is Important enough to be evaluated, 
and by whom, needs to be determined. Various faculty rol^e models 
differ from Institution to Institution, with the most common models 
employing the traditional basic Teaching-Research-Service rol^. A 
more comprehensive treatment of possible roles can be found in the work 
of Miller (1972). 

Briefly, the roles which have emerged and some of the activities 
which define the<;j? roles are as follows: 
A. Advising 

1. Advising students on programs of study 

2. Sponsor or advise student groups 

3. Chair Master's or Doctoral superylsory conmlttees 

4. Serve on Master's or Doctoral supervisory committees 
^B. Teaching 5. 

1. Teaching fegular course offerings 

2. Developing course materials * 

3. Developing repHcable systems of Instruction 
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Faculty Service 

1. Serving on departinentdl , college* or university cownlttees 

* 

2. Serving* on the,facultjy senate 
Administration and Management 

r 

1. Directing or managing an administrative unit 

2. Program or project management 
The- Arts 

1. Presenting recitals 

2. Staging, directing or acting In musical, theatrical, 
and dance productions 

3. Exhibiting paintings, sculptures, and other creative arts 
Publications 

1 . Books 

2. Journal and magazine articles 

3. Monographs, etc. 

Public Service (within the faculty member's area 'of expertise) 
K Serving on local, state, or national committees 
2; Holding public office 
Research 

1. Basic scientific Investigations, both theoretical and 
applied 

2. Investigations of educationally relevant problems 
Professional Status- 

K Activity in professional organizations ^ 
*2. Awards, honors, or invited presentations 
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dbvibusfy. the brief listings of activities under each rote head- 
ing shown are only meant to be representative and suggestive, and should 
not be considered as' complete definitions of each role. It is best that 
each institution set up' faculty committees or faculty workshops In 
the Initial stages of the development of a faculty evaluation system to ^ - 
determine which activities the faculty consider ^appropriate for 
defining each role. 

Severar efforts have been made at combining the definition of ^ 
faculty roles with a uniform value structure for an institution. 
W. R. Harper College in Palatine, Illinois, has developed a source-by- * 
role weighting matrix in an attempt to begin reflecting values of the 
faculty in its evaluation system (Genovdv et. al., 1976). Oackspn^ 



State Community College In Jackson, Tennessee, and Piedmont Technical 
College in Greenwood. South Carolina, have also undeHaken extensive 

* » 

X efforts to ascertain and develop evaluation procedures which reflect 
the. values of the faculty (Oackson State Coirmunity College, 1978; 
Piedmont Technical College. 1979). The form shown In Figure lb, with 
its suggested cover memo^ln Figure la, are samples of composite forms 
which may be employed in obtaining role definitional and faculty value 
information on which the faculty evaluation system may be based. 



Insert Figures la and lb about here 



Designing Data Gathering St^ateg1es 

Once the elements which constitute the roles In the faculty role 



ERIC 



9 



FACULTY EVAIUATION 
\ \ ^ Page 8 



«iodi&l appropriate to'jthe Institution have been defined, and the appro- 
priate data sources and value^ associated with each 'data source have 
been detenn1ned> it Is possible to begin designing the required data ' 
gathering strategies. In order to have an Integrated faculty evalua- 
tion system which will provide Information that can be utlli-red for 
promotion, tenure, and merit-pay decisions. It Is usefuj, to develop 
a procedure wh1<h produces a singular Index which Is readily Inter- * 

» * 

pretable. To produce such an Index, It Is only necessary to design 
all data gathering strategies* .such that the data thfiy 'produce can ul- 
tlmately be expressed on the same numerical scale. Thus, If* one of 
the -data gathering strategies reyqulres a rating form; another, .an 
Interview; and another, a checklist; the Information from each of ther,e 
devices or strategies must f1nallJ^^be expressed on the same scale. 

The following example will demonstrate the principles involved 
in applyini ^he procedures discussed to this point in the development 
of a* comprehensive faculty evaluatipn system.- 

EXAMPLE:' * ' . ^ 



Assume that wish to evaluate the Teaching role of the faculty* 
The first task la to determine what specific activities should 
be evBiluated. This was accomplished by asking faculty to describe 
the activities which const! tate Teaching In their view. The fol-' 
lowing definition emer^ged: 

Teachifti;^ ^ ^ ^ * 

a. Classroom performance (enthusiasm, clarity of exposition* 
organization, etc.) 
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b» Material pi»lparatlon (syllabus construction, tests con- ' 

* 1 * * ^ • 

' atruoted appropriately, effective handouts, etc.) 
o. Record -keeping (turns lu grades on ^Line, orders text, • 
files drop/add and withdrawal blips, etc.)i * . 

Using a form such as the one shown in Figure Ihj the faculty were 
also asl^ed to indicate how much wei^t should be placed on the data 
or information provided by eaoh data source listed* The faculty 
were., alijo asked to indicate how much weight 'or value should be ' 
placed on the input by« the various* sources relative to the specific 
activities 'wi"thin the Teaching roDsI? The general overall figures 
for the faculty as a whole derived by th5<^ procedure were as follows j 

••Hovr much weight shoul.! be placed on the input of the various \ 
. sources ^relative to -the total evaluation of the Teaching! role?" 

Teaching Students Peers Self Dept. Chair 

Total Weights 75$ 151 55^ 55^ 



t 

•Of the weights listed above, how should -the weights be distributed 
across specific teaching activities?" 

Teaehihg ^ » - > 

a. Classroom Ferforicanoe 501 * '2% 

b. Materltals Preparation 251 * 15%^ * ' 2% 

Recoil KecTplng « " 1% 5i 

Totals m m m 

* *v • ► . 
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Prom the above totml .weights^we can see that the facult/have ex» 

pressed the value that 75% ot weight of the evaluation of • 

their teaching should .be placed on the information provided by , 

students,, and that the 15% should be* distributed as 50^ on In- ' 

formation concerning classroom performance, with the remaining 25% 

. ■ »■ \ ■ * 

on material preparation, 'thus, in designing our da€a gathering 

Strategy for the, Teaching role, it will be necessary to develop 

some sort of questionnaire or other form to ' determine the student's 

reactions to rtot only classroom perfbrjiance, but to the materials 

prepared .and used by the instructor in the course, as well. Other 

►* • ■ , . ^ 

data gathering "strategies, such ae interviewing all or )>erhaps a 

select representat3*re few students from the class, are also*pos3i- 
bilities. s.. 



As can be seen In the figures at)0ve, the faculty in our hypothetical 

♦ * * * . . I ^ 

institution have determined that. the input from peers concerning 
the Teaching role should be focused mainly on the quality of the 

• , :> ^ ' ' 

materials prepared and used in the cdurse.. Accordingly, some 
protocol or formav. must be devel9ped that would permit peera to 
evaluate or Judge appropriate aspects of syllabi ,/ tests , handouts , * 

etc. Ihis information-gathering 4»trategy may be as detailed as 

* 

speclfVing form, .style, technique, or any of -a number of other 
characteristics of the material-, or it may be as geijeral as simply 
belhg an overall'set of guidelines for determining the' value of * 
the matvlala produced* 
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The strategy for obtaining information from%the individual faculty' 
meraber on the various elements of teaching may range from highly 
specific questions concerning: intent and instructional design - 
strategies to something [as general as global self-ratings. 

Finally, in our example the department chair is required to pro- 
vide input as to the record-keeping component of the faculty mem- 
ber«^s overall teaching performance* The Information gathering 
strategy here could be as detailed as a comprehensive checklist 
that the chair completes, or as simple as a form requiring only 
a handful of simple responses to basic procedural questions that 
the departmental secretary would complete. 

In any case, all of the above data gathering forms, proceckires, 
or protocols would ultimately be recorded on a common scale. 
Assuming a 1 to 5 scale with "1" being the lowest rating and ♦'5" 
being the highest, all information from the various sources would 
be translated into the common 1 to 5 scale. Note that the crlti- 
cal point in this example is not how a specific fora, question- 
naire, or procedure is designed, but rather the utilization of 

. ^« 
r * 

the various data gathering or measurement strategies in an inte- 
grated system which reflects the value structure of the faculty in 
the overall evaluation process. Thus, even though individual in- 
struments or forms may be designed and implemented before their 
psychonetric validity lias been completely researched, the syst^i 
as a whole will have "functional validity" since the results of 

- 13 
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the evaluations carried out should be more readily accepted by 
the faculty owing to the fact that the system reflects their 
values cor.cerning what should be evaluated and. by whom and to 
what degree. 

It should be stressed that in the example above the Issue of 
the specific validity of the particular Instruments, fomis» or 
questionnaires Is not being Ignor^. Rather, concern for those questions 
is placed In the proper perspective and dealt with In an appropriate 
sequence so as to maximize the successful design and Implementation of 
the entire faculty evaluation system. In a like manner as described 
in the example, infonnatlon gathering or measurement strategies could 
be designed for each role and for each data source concerning that role. 
It is unlikely, in a realistic setting, that any institution implement- 
ing a faculty evaluation system will have sufficient lead time to devel- 
op each instrument or strategy to such a degree that all questions con- 
cerning its psychometric characteristics (validity, reliability, etc.) 
will have been satisfactorily answered before being implemented. The 
determination of these characteristics takes a good deal of time and 
research. However, it Is recognized that Institutions must often 1ra- 
^ement a faculty evaluation system with whatever they have been able 
\> develop In an extremely short length of time.. The above described 
system will permit such an Implementation with even the most basic and 
elemental forms of measurement instruments or strategies, since the 
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critical components are not forms or questionnaires, but the value 
placed on the information provided. These values will reflect the 
faculty's collective values and thus the results of the system are 
fncre likely to be accepted and used» 

Individualizing the Syst em * 

Assuming that we have determined the value structure of the 
faculty in regards to the various roles to be evaluated, and by whom, 
and further assuming that all forms, protocols, and Information 
gathering strategies have been designed so as to result in ratings on 
a common scale, we arrive at the {Problem of how to take into account 
different faculty assignments. Given the diversity of possible activ- 
ities in which faculty may legitimately engage (as described earlier), 
the problem of evaluation revolves around the determination of the 
answers to the following questions: 

A. Which criteria (activities) is a faculty member to be held 
^ accountable for? 

B. How can a faculty member be evaluated in a manner ^hat 
assesses performance only on those criteria, yet permits 
comparison with other faculty whose chosen or assigned 
activities (criteria) may differ? 

The following steps suggest a method for answering these Ques- 
tions: 

A, Determining Crlter-^a 

1. Each faculty member would, in conjunction wl^h the 
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appropriate contracting agent (I.e., Dean» Dept. Chair, etc.), 
come to an agreement as to which combinationv of roles of 
activities would comprise the contractual responsibilities 
for the coming academic >ear. 

As part of the agreement, there would be an additional deter- 
mination and agreement as to the percentage of total weight 
which would be assigned to each role In the overall evalua- 
tion of the individual. Possible minimum and maximum wefghts 
for each role would hav^l ready been determined by the 
faculty and administration as a matter of policy, and eSch^ 
Individual assignment would have to fit within those. guide- 
lines. For example. If the Institution detennined that at 
least sot of a faculty member's overall performance evalua- 
tion must derive from the teaching role, no faculty member 
could choose to weight this role less than 50%. 
In the event that the contractual responsibilities or the 
relative degree of emphasis or commitment to those respon- 
sibilities should change substantially during the year; 
either at the request of the appropriate contracting agent, 
or the faculty member concerned, an evaluation of the per- 
formance to that point should be carried out within a reason- 
able amount of time. Any subsequent evaluation made on the 
adjusted contractual agreements should date from the ttme of 
the change. 
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B» Evaluation of Selected Roles in Criteria 

With the determination of the criteria for which a faculty 
member is to be held accountable* the evaluation of his or 
her performance would be^^ally individualized to the ex- 
tent that the faculty member would be evaluated only on 
? those activities agreed to and contracted for/ In addition/ 
the evaluation of a specific activity or role would be 
weighted in direct proportion to the agreed upon emphasis 
placed on that activity. An Individual's evaluation would 
^thus reflect the .extent to which the assigned responsibilities 
and duties had been carried out regardless of what they might 
be. In this manner, comparisons among faculty would be made 
on a singular. index of success in their endeavors, rather 
than trying to force their evaluations Into a common role model. 

Specifically, the 'evaluation system would employ various forms 
of rating devices, peer evaluations, student ratings, self- 
evaluations and supervisory evaluations, or combinations thereof, 
deemed appropriate to assess each activity. Cownerclal ratli^ 
scales and evaluative devices could be used if desired In eval- 
uating many facets of faculty perfomance. However, as sug- 
gested earlier, the faculty and administration (and perhaps 
students, too) should be Involved In the fonnuUtlon of spe^ 
Ific evaluation strategies. All evaluation or data-gathering 
device, however, result in a single numerical index expressed 
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on a comnon scale which reflects the extent to which the 
faculty met the criteria agreed upon. The Indices of per- 
formance would then be weighted according to the pre-asslgned 
weights and a composite weighted Index of performance would 
result. This ^composite index would then be comparable across 
all faculty, regardless of the specific criteria against which 
they were all being evaluated, 
EXAMPLE: Computing the Composite Role. Rating 
Assuming as in our earlier example that ,the faculty for an 
institution had determined that for the Teaching role, 75% 
of the weight of the total evaluation would be placed on the 
input from students, 155t from peers,' 5% from self, and 5% 
from the department chair, the composite rating for the Teach- 
ing role 'ould be computed as follows: 

Suppose, 5n a scale of 1 to -5, with 5 being high, we obtain 
the following ratings for an instructor on the Teaching role. 
Students... T,.,. . I| - « / 

Peers •*•.«.*••••.«.* 3 ^ ' ' 

Self* 3 

Itept. Chair..,..,,,.. 3 
To obtain the Composite Role Rating, we multiply each indivi« 
dual rating by the specified wei^t for each data aource. In 
actual practice, sooe form of standard score would be used 
instead of the raw rating so as to minimize the accumulation 



is 



FACULTY EVALUATION 
* Page 17 

of error In the over-all ratings. The raw ratings are used 
here only for the purposes of clarity. 

Students/. i| X = .3.00 " 

Peers...., 5 X 151 - ,75 

Self,..*.,.,......,. 3 X '51t a .15 

Dept. Chair......... 3 X 5$ s as ' 

Composite Bole Rating = H.OS 

For the remainder of the example,- assume that all Composite 
Ratinns for pach role have been computed in like fashion. 

Assume that Processor Jones has selected the following 
activities or roles and th*i coivesponding wei^ts for his 
contractual responsibilities: » 

Teaching 50$ 

Research lOJ 

Faculty Service..... 25% 

Administration. ..... I5jt 

Further, assume that all evaluation devices or data^therlng 
strategies used to rate his performance In each role share 
the common scale of 1 to 5 whene "I" represents a minimal rat. 
ing and ♦»5» represents a maximal one, and that all Conpoait* 
Role Ratings are computed in the fashion shown above. Upon 
being rated in each role. Professor Jones receives the fol- 
lowing total evaluation: 

.19 
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WEIGHT 




COMPOSITE 
RATING 


WEICHTED 
RAIING 


Teaching 


. 5055 


X 


i».05 


= 2.025 


Research 


1055 


X 


3.75 


- •375 


Faculty Services 


25% 


X 


3.50 5 


^ .875 


Adminis t rat ion . 


155t 


X 


•3.00 i 


' MO 




OVERALL COMPOSITE RATING j 


3.725 


Similarly, .Professor Smith, has roles, weights, and rating 


ROLE 


WEIGHT 




COMPOSITE 
RATING 


, WEIGHTED 
RATING 


Teaching 


50% 


X 

* 


3.75 = 


1.875 


Research 




X 


M.25 s 


= ^ 1.700 


Publications 


10$ 


X 


i|*.75 = 


.^75 




.OVERALL COMPOSITE RATING = 


4.050 



Thus, even though both faoulty have somewhat different assign- 
ments, with diffe^«ential weights being given their various 
roles, the OVEpALL COMPOSITE RATING of 3-725 for Professor 
Jones compared against the OVERALL COMEOSITE RATING of 4.05 
for Professor Smith indicates that Professor Smith has been 
perceived and adjudged as achieving greater success in her 
endeavors than PjX)fessor Jones. 

Therefore, as Illustrated above, each faculty meniber may select 
different and Individualized criteria against which to be evaluated 
*<hile still enabling comparisons with other faculty members when such 
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comparisons are necessary for promotion and tenure decisions. 

* 

Evaluations and Merit Pay ^ ' 

It may be argued that the system described above results in 
Ating figures that Imply a precision of measurement which is not 
practically possible. It sj^uld be noted, nowever, that the OVERALL 
COMPOSITE RATING figures reflect not only the ratings given by in- 
dividual s on various roles, but also the value structure of the fac- 
ulty. It is this value structure which is being reflected with pre- 
cision In composite ratings carried out to two or three decimal places. 
It should be remembered that each Composite Role Rating is comprised 
of several different measures from several different sources, and thus 
accuracy in the OVERALL COMPOSITE RATING is, I believe, both warranted 
and necessary. In addition, such accuracy becomes useful when we wish 
to utilise the OVERALL COMPOSITE RATING for the determination of merit 
pay Increases. 

The following equation can be used to compute merit pay based 
upon a faculty member's* OVERALL COMPOSITE RATING: 

RAISE « MERIT UNIT X OVERALL COMPOSITE RATING 

Where: MERIT UNIT « TOTAL MERIT MONEY AVAILABLE IN RAISE POOL 

GRAND TOTAL OF ALL ELIGIBLE OVERALL COMPOSITE RATINGS 

To use this equation* certain assumptions must be made* Assuming, 
first, that we are using a conmon rating (In our example, a 1 to 5 
scale), and furtber assuming that it has been determined as a matter 6f 
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policy that any faculty members obtaining an OVERALL COMPOSITE RATING 
of between 1.000 and 1.999 are not ellglble^for merit raises (since 
such ratings would be reflective of below satisfactory perf omance) » 
the equation would be used as follows: 

1. The total monies available for the raise pool would be deter- 
rofhed by the customary, present budgetary procedures. For the 
purposes of notation, this totarmerit money Is designated TMM. 

2. TheWRALL COMPOSITE- RATINGS of all eligible faculty (I.e., 
, faculty with OVERALL COMPOSITE RATINGS of 2.000 or higher), 

would be summed to produce the Grand Total of all OVERALL COM- 
POSITE RATINGS aiid Is designated as GTR. 

3. The total merit money (TMM) would be divided by the grand total 
of the eligible ratings (6TR) to produce the Merit Unit (MU). 

4. To. determine an Indlviduafs jnerlt rals^, his OVERALL COMPOSITE 
RATING (OCR) would be multiplied by the Merit Unit (MU). This 

. leads to the equation: 

RAISE, = i1U X,OCR, Where: MU = 2WM — 

* . m 

The following Is an example of an application of the formula: 

Suppose that a given department with ;10 faculty members is given 
" a riise pool of ^0, 000.00. Further, suppose that only 7 of the \ 
10 faculty have OVERALL COMPOSITE RATINGS of 2,000 or greater, and 
that the sum of all these seven OCR's is 26.92. 
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First, the Merit Unit (MU) for the department is computed j 



MU = 1^ ' MU » mtOOO m s $371.^7 

GTR 26«92 



Thus, for Professor Jones, with his OVERALL COMPOSITE RATING 
of S-TSS, we 'would compute a raise oft 



RAISE 5 • MU X OCR RAISE j= $371.47 x 3.725 

RAISE = $1,383.73 

While Professor Smith, with her OCR of 4.05, would receive a 
raise ott 

RAISE = MU X OCR RAISE s $371.47 x 4.05 

RAISE s $1,504.45 

Utilizing the above isVstein 4nd equations t merit raises can be 
tied directly to evaluations in a manner that should be viewed as fair 
and e<iu1 table. Note that under this system, no single administrator 
Is solely responsible fOr determining who gets how much of a raise* 
Input has been received from a variety of sources concerning the per- 
formance of faculty In a nuroBer of different roles, and the resultant 
ratings directly Influence the' raises avfarded, Jhls system In no way 
hinders the responsible administrator from reinforcing or rewarding 
departments as a whole* since this can be accomplished by providing 
larger raise pools to the departm^t. 
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Conclusion ^ ^ 

What have been outlined in this discussion are merely the high- 
light^f a procedure which, in various forms, can and has been success* 
fully developed by the author In several colleges and universities' 
around the^country. Needless to say, not all aspects of the system 
have been dealt with in great detail owing to a lack of space in the 
presQnt format,. Obviously missing is a detailed outline of the develop- 

« 

ment of the poliicies and operating procedures which must be built along 
with the system, as well as a discussion of .cost and the organizational 
structures necessary to run it. However, the system permits such a 
degree of flexibility, and. in fact, encourages and promotes individuali- 
zation in Its application, that it should be possible to Implement in 
any of a large number of institutional and organizational settings. 

V 
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MEMORANDUM , * • 

TOi All Faculty ' ^ 

Ii^'tnrder to assist us In designing a faculty evaluation systen that 1s 
val1d» fair, and equitable to all faculty being evaluated^ It is neces*- 
sary that we determine the answers to. the following questions:, 

1. What shbuld be the relative weight placed on each of the roles 
faculty pla^ in the eva^lua1f-1on of overall performance? 

2. What specif lV activities define each role? r 

♦3. From whom should the infonnation be gathered .concerning your 
performance In each role? 

4. .How much value or we4ght should be placed on the Information 
provided by each source in the detertn1natix)n of your overall 
evaluation? 

To determine the answers to these questions ,*we asic that you fill out ' 
the matrix on the fcfl lowing page with the Information requested below: 

K In the parentheses next to each faculty rpl enlisted indicate 
the MINIMUM weight that should be placed on that role in the 
evaluation process. For example, tinder the TEACHING role, if 
you believe that every faculty member's total evaluation should 
be weighted at least BOX on his or her teaching performance, 
• place "50" in the parentheses. 

2. In the space underneath each role heading, list some of the^ 
activities which you believe should define or determine that 

^ role. . * 

3. In the cells under the columns headed STUDENTS, PEERS, SELF, 
DEPT. CHAIR K ana OTHER, indicate the percentag€^ of weight whlch- 
should be placed on the Input or information provided by each * 
source relative to each role or activity for the purposes .of 
evaluation. For example, unde** the TEACHING role. If you 
believe what students report about your teaching performance- 
should weigh the heaviest in the evaluation of your teaching, 
you may choose to plate 7 5X under STUDENTS, lOt under PEERS^ 

St under SELF, and lOX under DEPT. CHAIR. If, on the ottier 
hand, you believe that what your PEEI« and ALUMNI rejiort con- 
cerning your teaching should be welgKted fnost heavily, you may 
wish to. distribute the weights In some manner such as lOX under 
* STUDENTS, 60% under PEEKS, 5t under SELFt, 5% under DEPT. CHAJR, 
and 20% under OTHER (ALUWII). 

Thank you for your cooperation in assisting -In the design of our faculty 
evaluation system. 



ROLCS 



FIGURE lb. 

4 



* 



{ ) TEACHING 

2 I 



2. "'^^ 



3. 



1) AOHINISTRATION 



1. 



2. 



( ) PUBLIC SERVICE 



1 



( ) RESEARCH 



1. 



( ) PUBLICATIONS 



1. . 



2. 



( ') .THE ARTS ' 



2. 



( ) MOfESSlONAL STATUS 



il 
3, 



j^.. 



STUDENTS 



SELF 



DEPT. 
CftAlB 



Specify 



• » FACULTY EVAtUATION 

REFERENCES 

Costin, F., 6reenough» W.T., and Menges; R J»» "Student Ratings of College 
Teaching: Reliability, Validity, and Usefulness," Review of Educational 
Rese&rch , 41 (1971) 511 - 535 

'I 

Genova, W»0., Madoff, M.K*, Chin, R., and Thomas, G»B»3 Mutual Benefit 
Ev aluation of Faculty and Admlristrators In Higher Education , Ballinger 
Publishing Co., Cambridge, Mass. 1976 

Grasha, Anthony F., Asse ssing and Developing Faculty Performance: Prlnci- 
pies and Models, Cornnunication and Education Associates, Cincinnati, Ohio 
1977 

Jackson State Community College, Co mprehensive racultv Evaluation System , 
Jackson State Corrmunity College, Jackson, Tennessee, 1978 

c»iedmont Technical College, Institutional Directive 3>9 , Piedmont Technical 
College, Greenwood, South Carolina, 1979 

♦ 

Miller, Richard I., Evaluating Faculty P^rfonnance . Jossey-Bass Inc., San 
Francisco, 1972 ^ 

Miller, Richard K» Developing Programs far faculty Evaluation: A Source 
Book , Jossey-Bass Inc., San Francisco, 1974 



